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Abstract — Common approach to radial distortion is by 
the means of polynomial approximation, which introduces 
distortion-specific parameters into the camera model and re- 
quires estimation of these distortion parameters. The task 
of estimating radial distortion is to find a radial distortion 
model that allows easy undistortion as well as satisfactory 
accuracy. This paper presents a new radial distortion model 
with an easy analytical undistortion formula, which also be- 
longs to the polynomial approximation category. Experi- 
mental results are presented to show that with this radial 
distortion model, satisfactory accuracy is achieved. 
Key Words: Camera calibration, Radial distortion, Radial 
undistortion. 



I. Introduction 

Cameras are widely used in many engineering automa- 
tion processes from visual monitoring, visual metrology to 
real time visual servoing or visual following. We will focus 
on a new polynomial radial distortion model which intro- 
duces a quadratic term yet having an analytical undistor- 
tion formula. 

A. Camera Calibration 

Camera calibration is to estimate a set of parameters 
that describes the camera's imaging process. With this set 
of parameters, a perspective projection matrix can directly 
link a point in the 3-D world reference frame to its projec- 
tion (undistorted) on the image plane by: 
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where (u, v) is the distortion-free image point on the image 
plane; the matrix A fully depends on the camera's 5 intrin- 
sic parameters (a, 7, /?, uq, vq) with (a, (3) being two scalars 
in the two image axes, (uo, i>o) the coordinates of the princi- 
pal point, and 7 describing the skewness of the two image 
axes; [X C ,Y C , Z C ] T denotes a point in the camera frame 
which is related to the corresponding point [X W ,Y W , Z W ] T 
in the world reference frame by P c — RP W + t with (R, t) 
being the rotation matrix and the translation vector. For 
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a variety of computer vision applications where camera is 
used as a sensor in the system, the camera is always as- 
sumed fully calibrated beforehand. 

The early works on precise camera calibration, start- 
ing in the photogrammetry community, use a 3-D calibra- 
tion object whose geometry in the 3-D space is required 
to be known with a very good precision. However, since 
these approaches require an expensive calibration appara- 
tus, camera calibration is prevented from being carried out 
broadly. Aiming at the general public, the camera cali- 
bration method proposed in P focuses on desktop vision 
system and uses 2-D metric information. The key feature 
of the calibration method in is that it only requires the 
camera to observe a planar pattern at a few (at least 3, if 
both the intrinsic and the extrinsic parameters are to be 
estimated uniquely) different orientations without knowing 
the motion of the camera or the calibration object. Due to 
the above flexibility, the calibration method in £Q is used in 
this work where the detailed procedures are summarized as: 
1) estimation of intrinsic parameters, 2) estimation of ex- 
trinsic parameters, 3) estimation of distortion coefficients, 
and 4) nonlinear optimization. 

B. Radial Distortion 

In equation (u, v) is not the actually observed image 
point since virtually all imaging devices introduce certain 
amount of nonlinear distortions. Among the nonlinear dis- 
tortions, radial distortion, which is performed along the 
radial direction from the center of distortion, is the most 
severe part [2], 0. The radial distortion causes an inward 
or outward displacement of a given image point from its 
ideal location. The negative radial displacement of the im- 
age points is referred to as the barrel distortion, while the 
positive radial displacement is referred to as the pincush- 
ion distortion ; 3J. The removal or alleviation of the radial 
distortion is commonly performed by first applying a para- 
metric radial distortion model, estimating the distortion 
coefficients, and then correcting the distortion. 

Lens distortion is very important for accurate 3-D mea- 
surement p]. Let (v,d,Vd) be the actually observed image 
point and assume that the center of distortion is at the 
principal point. The relationship between the undistorted 
and the distorted radial distances is given by 



Td 



(2) 



where rd is the distorted radial distance and S r the radial 
distortion (some other variables used throughout this paper 
are listed in Table HJ). 



TABLE I 
List of Variables 



Variable 


Description 


(Ud, Vd) 


Distorted image point in pixel 


(it, v) 


Distortion-free image point in pixel 


(x d , Vd) 


[x<l> Vd, 1] T = A- 1 ^, v d , 1] T 


(x, y) 


[x, y, l] T = A-^[u, v, If 


Td 


2 2 i 2 

r d = x d + Vd 


r 


r 2 = x 2 + y 2 


k 


Radial distortion coefficients 



Most of the existing works on the radial distortion mod- 
els can be traced back to an early study in photogrammetry 
[5] where the radial distortion is governed by the following 
polynomial equation pQ, [S], [7], 

r d = r f(r) = r (1 + k Y r 2 + k 2 r 4 + k 3 r 6 + ■■•), (3) 

where hi, ka, . . . are the distortion coefficients. It follows 
that 

Xd = xf(r), yd = yf(r), (4) 
which is equivalent to 

( u d - u a = (u - ito) f(r) 

\ v d ~v = (v-v ) f(r) ' ! " 

This is because 

u d = axd + jyd + uo, 

= axf(r) +jyf(r) +u 

= {u- u ) f(r) + u a 

Vd = Pyd + v . 

= (v- v ) f(r) + v 

For the polynomial radial distortion model Q and its 
variations, the distortion is especially dominated by the 
first term and it has also been found that too high an or- 
der may cause numerical instability [3], PO, 0- In this 
paper, at most two terms of radial distortion are consid- 
ered. When using two coefficients, the relationship between 
the distorted and the undistorted radial distances becomes 

m 

r d = r(l + k ir 2 + k 2 r 4 ). (6) 

The inverse of the polynomial function in JSJ is difficult to 
perform analytically but can be obtained numerically via 
an iterative scheme. In |10| . for practical purpose, only one 
distortion coefficient fci is used. 

For a specific radial distortion model, the estimation 
of distortion coefficients and the correction of radial dis- 
tortion can be done by correspondences between feature 
points (such as corners P and circles HU), image regis- 
tration |12|. the plumb-line algorithm and the blind 



removal technique ; 1 11 that exploits the fact that lens dis- 
tortion introduces specific higher-order correlations in the 
frequency domain. However, this paper mainly focuses on 
the radial distortion models, advantages and disadvantages 
of the above four calibration methods are not further dis- 
cussed. 

In this work, a new radial distortion model is proposed 
that belongs to the polynomial approximation category. To 
compare the performance of different distortion models, fi- 
nal value of optimization function J, which is defined to be 

HI: 

N n 
»=1 3=1 

is used, where m(A, k, R^, t,, Mj) is the projection of point 
Mj in the i th image using the estimated parameters; k de- 
notes the distortion coefficients; Mj is the j th 3-D point 
in the world frame with Z w =0; n is the number of fea- 
ture points in the coplanar calibration object; and N is the 
number of images taken for calibration. In PP, the estima- 
tion of radial distortion is done after having estimated the 
intrinsic and the extrinsic parameters and just before the 
nonlinear optimization step. So, for different radial dis- 
tortion models, we can reuse the estimated intrinsic and 
extrinsic parameters. 

The rest of the paper is organized as follows. Sec. ITU de- 
scribes the new radial distortion model and its inverse ana- 
lytical formula. Experimental results and comparison with 
the existing polynomial models are presented in Sec. II I II 
Finally, some concluding remarks are given in Sec. IIVI 

II. The New Radial Distortion Model 
A. Model 

The conventional radial distortion model JJjJ with 2 pa- 
rameters does not have an exact inverse, though there are 
ways to approximate it without iterations, such as the 
model described in |1 1 j . where r can be calculated from 
rd by 

r = r d (l-k 1 r 2 d -k 2 rj). (8) 

The fitting results given by the above model can be sat- 
isfactory when the distortion coefficients are small values. 
However, equation JSJ) introduces another source of error 
that will inevitably degrade the calibration accuracy. Due 
to this reason, an analytical inverse function that has the 
advantage of giving the exact undistortion solution is one 
of the main focus of this work. 

To overcome the shortcoming of no analytical undistor- 
tion formula but still preserving a comparable accuracy, 
the new radial distortion model is proposed as [15j : 

rd = rf(r)=r(l + k ir + k 2 r 2 ), (9) 

which has the following three properties: 
1) This function is radially symmetric around the center 
of distortion (which is assumed to be at the principal point 
(uq,Vq) for our discussion) and it is expressible in terms of 
radius r only; 



2) This function is continuous, hence r<2 = iff r = 0; 

3) The resultant approximation of Xd is an odd function 
of x, as can be seen next. 

Introducing a quadratic term k\ r 2 in JJjJ , the new distor- 
tion model still approximates the radial distortion, since 
the distortion is in the radial sense. 
From 10, we have 



Xd 

Vd - 



xf{r) 

yf(r) 



■ x (1 + kir + k 2 r 2 ) 
y (1 + fcir + kir 2 ) 



(10) 



It is obvious that Xd = iff x = 0. When Xd ^ 0, by letting 
c = Vd/xd = y/x, we have y — cx where c is a constant. 
Substituting y — cx into the above equation gives 



:td 



x 1 + k\\/ x 2 + c 2 x 2 + k 2 (x 2 + c 2 x 2 ) 

x 1 + fex \/l + c 2 sgn(x)a; + fc 2 (l + c 2 )x 2 

.t + fci v 7 ! + c 2 sgn(ir) x 2 + fc 2 (l + c 2 ) a; 3 , (11) 



where sgn(a:) gives the sign of x and Xd is an odd function 
of x. 

The well-known radial distortion model that de- 
scribes the laws governing the radial distortion does not 
involve a quadratic term. Thus, it might be unexpected to 
add one. However, when interpreting from the relationship 
between (xd, yd) and (x, y) in the camera frame as in equa- 
tion the radial distortion function is to approximate 
the Xd <-> x relationship which is intuitively an odd func- 
tion. Adding a quadratic term to 8 r does not alter this fact. 
Furthermore, introducing quadratic terms to S r broadens 
the choice of radial distortion functions. 

Remark II. 1: The radial distortion models discussed in 
this paper belong to the category of Undistorted-Distorted 
model, while the Distorted-Undistorted model also exists in 
the literature to correct the distortion JSj . The new radial 
distortion model can be applied to the D-U formulation 
simply by defining 



r = r d (1 + ki r d + k 2 r 2 ). 



(12) 



Consistent results and improvement can be achieved in the 
above D-U formulation. 

B. Radial Undistortion of The New Model 
From JSJ, we have 

r 3 + ar 2 +br + c = 0, 



with a — k\/k,2, b = l/fc 2 , and c : 
the above equation becomes 

f + p r + < 



-fd/k 2 . Let r = r — a/3, 



0. 



where p = b - a 2 /3, q = 2a 3 /27 - ab/3 + c. Let A = 
(f ) 2 + (f ) 3 - If A > 0, there is only one solution; if A = 0, 
then r = , which occurs when 8 r =0; if A < 0, then 
there are three solutions. In general, the middle one is 
what we need, since the first root is at a negative radius 



and the third lies beyond the positive turning point |17| . 
18 . After r is determined, (u, v) can be calculated from 
(JSJ) uniquely. 

The purpose of this work is to show that by adding a 
quadratic term to 8 r , the resultant new model achieves the 
following properties: 

1) Given rd and the distortion coefficients, the solution of 
r from rd has closed-form solution; 

2) It approximates the commonly used distortion model 
© with higher accuracy than f(r) = 1 + kr 2 based on the 
final value of the optimization function J in |7jl. as will be 
presented in Sec. IIIII 



III. Experimental Results and Comparisons 

In this section, the performance comparison of our new 
radial distortion model with two other existing models is 
presented based on the final value of objective function J 
in (JZJ) after nonlinear optimization by the Matlab function 
fminunc, since common approach to camera calibration is 
to perform a full-scale nonlinear optimization for all param- 
eters. The three different distortion models for comparison 



distortion modeli 
distortion model 2 
distortion model 3 



f(r) =l + fci r 2 + k 2 r\ 

f(r) =l + fci r 2 , 

f(r) = l + kir + k 2 r 2 . 



Notice that all the three models are in the polynomial ap- 
proximation category. 

Using the public domain test images [HJ\, the desktop 
camera images |20] (a color camera in our CSOIS), and 
the ODIS camera images [SU], |2J (the camera on ODIS 
robot built in our CSOIS), the final objective function J, 
the 5 estimated intrinsic parameters (ct,@, ~/,iaq,vq), and 
the estimated distortion coefficients {k\,k 2 ) are shown in 
Tables [HI IIIII and IIVI respectively. The extracted corners 
for the model plane of the desktop and the ODIS cameras 
are shown in Figs.n an d[2l As noticed from these images, 
the two cameras both experience a barrel distortion. The 
plotted dots in the center of each square are only used for 
judging the correspondence with the world reference points. 

From Tables |n] IIIII and IIVI it is observed that the final 
value of J of model3 is always greater than that of modeli, 
but much smaller than that of models . The comparison 
between models and models might not be fair since the new 
model has one more coefficient and it is evident that each 
additional coefficient in the model tends to decrease the 
fitting residual. However, our main point is to emphasize 
that by adding a quadratic term in <5 r , higher accuracy 
can be achieved without sacrificing the property of having 
analytical undistortion function. 

A second look at the results reveals that for the camera 
used in JH], which has a small lens distortion, the advan- 
tage of model3 over models is not so significant. However, 
when the cameras are experiencing a severe distortion, the 
radial distortion model3 gives a much better performance 
over model2, as can be seen from Tables ITTTl and llVl 

Remark III.l: Classical criteria that are used in the com- 
puter vision to assess the accuracy of calibration includes 
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Fig. 1 

Five images of the model plane with the extracted corners (indicated by cross) for the desktop camera. 
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Fig. 2 

Five images of the model plane with the extracted corners (indicated by cross) for the ODIS camera. 



the radial distortion as one part inherently 0]. However, 
to our best knowledge, there is not a systematically quan- 
titative and universally accepted criterion in the literature 
for performance comparisons among different radial distor- 
tion models. Due to this lack of criterion, in our work, the 
comparison is based on, but not restricted to, the fitting 
residual of the full-scale nonlinear optimization in . 

Remark III. 2: To make the results in this paper re- 
producible by other researchers for further investigation, 
we present the options we use for the nonlinear op- 
timization: options = optimset( 'Display' , 'iter', 
'LargeScale' , 'off, 'MaxFunEvals ' , 8000, 'TolX' , 
1CT 5 , 'TolFun', 1CT 5 , 'Maxlter', 120). The raw 
data of the extracted feature locations in the image plane 
are also available |2"H] . 

TABLE II 

Comparison of Distortion Models Using Public Images 



Public Images 


Model 


#1 


#2 


#3 


J 


144.8802 


148.2789 


145.6592 


a 


832.4860 


830.7425 


833.6508 


7 


0.2042 


0.2166 


0.2075 


u 


303.9605 


303.9486 


303.9847 


P 


832.5157 


830.7983 


833.6866 


vo 


206.5811 


206.5574 


206.5553 


fci 


-0.2286 


-0.1984 


-0.0215 


k 2 


0.1905 




-0.1566 



TABLE III 

Comparison of Distortion Models Using Desktop Images 



Desktop Images 


Model 


#1 


#2 


#3 


J 


778.9767 


904.6797 


803.3074 


a 


277.1449 


275.5953 


282.5642 


7 


-0.5731 


-0.6665 


-0.6199 


u 


153.9882 


158.2016 


154.4913 


P 


270.5582 


269.2301 


275.9019 


vo 


119.8105 


121.5257 


120.0924 


ki 


-0.3435 


-0.2765 


-0.1067 


k 2 


0.1232 




-0.1577 



IV. Concluding Remarks 

This paper proposes a new radial distortion model for 
camera calibration that belongs to the polynomial approx- 
imation category. The appealing part of this distortion 
model is that it preserves high accuracy together with an 
easy analytical undistortion formula. Performance com- 
parisons are made between this new model with two other 
existing polynomial radial distortion models. Experiments 
results are presented showing that this distortion model 
is quite accurate and efficient especially when the actual 
distortion is significant. 
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